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Abstract 

Parametric  partial  differential  equations  are  commonly  used  to  model  physical  systems.  They  also 
arise  when  Wiener  chaos  expansions  are  used  as  an  alternative  to  Monte  Carlo  when  solving  stochastic 
elliptic  problems.  This  paper  considers  a  model  class  of  second  order,  linear,  parametric,  elliptic  PDEs  in 
a  bounded  domain  D  with  coefficients  depending  on  possibly  countably  many  parameters.  It  shows  that 
the  dependence  of  the  solution  on  the  parameters  in  the  diffusion  coefficient  is  analytically  smooth.  This 
analyticity  is  then  exploited  to  prove  that  under  very  weak  assumptions  on  the  diffusion  coefficients, 
the  entire  family  of  solutions  to  such  equations  can  be  simultaneously  approximated  by  multivariate 
polynomials  (in  the  parameters)  with  coefficients  taking  values  in  the  Hilbert  space  V  =  Hq  (D)  of  weak 
solutions  of  the  elliptic  problem  with  a  controlled  number  of  terms  N.  The  convergence  rate  in  terms  of 
N  does  not  depend  on  the  number  of  parameters  in  V  which  may  be  countable,  therefore  breaking  the 
curse  of  dimensionality.  The  discretization  of  the  coefficients  from  a  family  of  continuous,  piecewise  linear 
Finite  Element  functions  in  D  is  shown  to  yield  finite  dimensional  approximations  whose  convergence 
rate  in  terms  of  the  overall  number  Ndof  of  degrees  of  freedom  is  the  minimum  of  the  convergence  rates 
afforded  by  the  best  TV-term  sequence  approximations  in  the  parameter  space  and  the  rate  of  Finite 
Element  approximations  in  D  for  a  single  instance  of  the  parametric  problem. 


1  Introduction 

1.1  A  class  of  parametric  PDE’s 

This  paper  is  concerned  with  simultaneously  solving  a  family  of  elliptic  equations  on  a  bounded  Lipschitz 
domain  D  C  of  the  form 

— V  •  (aVtt)  =  /  in  D,  u\aD  =  0,  (1.1) 

where  the  diffusion  coefficients  a(x ,  y)  are  functions  of  x  =  (aq, . . . ,  Xj)  G  D  and  of  parameters  y  =  (t/i,  2/2,  •  ■  •) 
which  may  be  finite  or  infinite  in  number.  The  right  hand  side  /  is  a  fixed  function  on  D ,  and  the  gradient 
operator  V  is  taken  with  respect  to  x.  The  solution  u(x,  y)  also  depends  on  these  variables.  Parametric 
problems  of  this  type  arise  in  modeling  complex  systems  in  various  contexts: 
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•  Stochastic  modelling:  the  parameters  y  are  realizations  of  random  variables  which  account  for  the 
fact  that  the  diffusion  coefficient  is  not  known  exactly  and  is  therefore  modelled  as  a  random  field. 
The  user  is  interested  in  the  resulting  statistical  properties  of  the  solution  u,  such  as  the  mathematical 
expectation  u{x)  :=  E{u{x))  or  the  solution’s  two-point  correlation  Cu(x,  x')  :=  E((u(x)—u(x))(u(x')  — 
u(x'))).  This  is  the  point  of  view  adopted  for  example  in  [14,  16,  4,  13,  3,  18,  19]. 


•  Deterministic  modelling:  the  parameters  y  are  known  or  controlled  by  the  user,  who  is  interested  in 
studying  the  dependence  of  u  with  respect  to  these  parameters  for  various  purposes  (for  example, 
optimizing  an  output  of  the  equation  with  respect  to  y) .  This  is  the  point  of  view  adopted  for  example 
in  [7,  17], 

A  major  idea  for  solving  such  families  of  equations  is  to  exploit  the  fact  that  the  solution  depends  smoothly 
on  the  coefficient  a.  Using  this  smooth  dependence,  the  hope  is  to  show  that  one  can  simultaneously  solve  the 
entire  parametric  family  of  equations  to  an  accuracy  e,  with  reasonable  computation  cost  regardless  of  the 
number  of  involved  parameters,  therefore  not  exhibiting  the  curse  of  dimensionality.  The  main  goal  of  this 
paper  is  to  give  theoretical  results  which  support  this  viewpoint.  Namely,  we  shall  prove  that  under  very 
minimal  assumptions  on  a(x,y),  the  solution  u(x,  y)  has  a  power  series  representation  in  y  with  suitably 
decaying  coefficients.  We  shall  give  a  quantitative  theory  which  describes  how  many  terms  of  such  an 
expansion  are  necessary  to  capture  the  solution  to  a  given  tolerance  e. 

In  order  to  formulate  our  results,  we  begin  by  recalling  a  few  standard  results  for  elliptic  equations  of  the 
form  (1.1).  To  begin  our  discussion,  let  us  first  consider  the  case  where  we  want  to  solve  only  one  equation, 
i.e.  a(x,z)  =  a(x)  depends  only  on  x  €  D.  Central  to  elliptic  theory  is  the  Sobolev  space  V  :=  Hq(D ), 
called  the  energy  space,  which  is  the  set  of  all  functions  v  whose  trace  vanishes  on  the  boundary  of  D  and 
whose  energy  norm  ||v||y  :=  ||  Vr:||i2(£))  is  finite.  The  dual  of  V  is  denoted  by  V*  =  H~1(D).  The  solution 
of  (1.1)  is  defined  for  any  f  £  V*  in  weak  form  as  a  function  u  £  V  which  satisfies 


/o(r)Vu(i)  Vv(x)dx 

D 

Under  the  assumption  that 


J  f(x)v(x)dx.  for  all  v  €  V, 

D 


0  <  r  <  a(x)  <  R  <  oo,  x  £  D, 

the  Lax-Milgram  Lemma  ensures  the  existence  and  uniqueness  of  the  solution  u  of  (1.2)  in  V. 
this  solution  satisfies  the  a-priori  estimate 


(1.2) 

(1.3) 

Moreover, 


\Mv  < 


(1.4) 


Of  key  importance  to  further  development  is  the  fact  that  Lax-Milgram  theory  can  be  extended  to  the  case 
where  the  coefficient  function  a  is  complex  valued.  In  this  case,  the  ellipticity  assumption  (1.3)  should  be 
replaced  by 

0  <  r  <  3?(a(a:))  <  |a:(;r)|  <  R  <  oo,  x  £  D.  (1-5) 


and  all  the  above  results  remain  valid  with  the  usual  extension  of  Sobolev  spaces  to  complex  valued  functions. 

With  these  facts  in  hand,  let  us  return  to  our  main  interest,  which  is  to  solve  the  family  of  elliptic 
equations  (1.1).  Rather  than  striving  for  utmost  generality,  we  consider  affine  dependence  of  a  with  respect 
to  y,  which  means  that  the  parameters  y.j  are  the  coefficients  of  the  function  a  in  some  formal  series  expansion 


a(x,y)  =  a(x) +  '^2yjtpj(x),  x  £  D,  (1.6) 

i=i 
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where  a  £  L°°(D)  and  {ipj}j>i  C  L°°(D).  The  sequence  {ipj}j>  1  could  either  be  given  to  us  by  the  physical 
system  we  are  modeling  or  its  choice  could  be  at  our  discretion.  For  example,  a  typical  choice  for  the  {ipj} 
in  the  stochastic  context  are  the  elements  of  the  Karhunen-Loeve  basis,  which  means  that  a  is  the  average 
of  a  and  that  the  yj  are  pairwise  decorrelated  random  variables,  but  we  may  as  well  choose  other  bases  such 
as  wavelets.  In  certain  models  where  the  parameters  are  finitely  many,  the  sequence  {ipj}j>i  may  not  be  a 
complete  basis  of  L2(D).  For  example  in  the  case  where  a  is  piecewise  constant  with  respect  to  a  partition 
of  the  domain  D  =  D i  U  . . .  U  Dk  into  measurable  sets,  it  is  then  natural  to  represent  it  as 

K 

a(x,y)  =  a(x) +  x  £  D,  (1.7) 

3= i 

where  a(x )  is  itself  piecewise  constant  on  this  partition  and  ipj  :=  Xdj- 

We  are  interested  in  simultaneously  approximating  the  solutions  u{y)  to  the  family  of  elliptic  equations 
with  the  above  input  parameters.  In  the  decomposition  (1.6),  we  have  the  choice  to  either  normalize  the  basis 
(e.g.,  assume  they  all  have  norm  one  in  some  space)  or  to  normalize  the  parameters.  It  is  more  convenient 
for  us  to  do  the  latter.  This  leads  us  to  the  following  assumptions  which  shall  be  made  throughout: 

i)  For  all  j  £  N  :  ipj  £  L°°(D)  and  ipj{x)  is  defined  for  all  x  £  D, 

ii)  the  y  =  (j/1,2/2,  ■  •  •)  to  be  considered  are  all  in  the  set  U  =  [—1, 1]N,  i.e.  the  unit  ball  of  the  sequence 
space  f°°(N)  (with  N  replaced  by  {1, ... ,  K}  in  the  case  (1.7)  that  the  number  of  parameters  is  finite), 

iii)  for  each  a(x,  y)  to  be  considered,  we  have  for  every  x  £  D  and  every  y  £  U 

a(x,y)  =  a(x)  +  ^2yjipj(x).  (1.8) 

3>  1 

Under  these  assumptions,  we  consider  the  map  y  1— >  u{y)  from  U  to  V,  where  u(y)  is  the  solution  of  (1.1) 
with  coefficient  given  by  (1.8).  We  shall  work  under  the  assumption  that  the  ellipticity  condition  (1.3)  holds 
uniformly  for  y  £  U. 

Uniform  Ellipticity  Assumption:  there  exist  0  <  r  <  R  <  00  such  that  for  all  x  £  D  and  for  all 
y  £  U 

0  <  r  <  a(x,  y)  <  R  <  00.  (1.9) 


We  refer  to  assumption  (1.9)  as  UEA(r,f?.)  in  the  following.  In  particular,  UEA(r,  R)  implies  r  <  a(x)  <  R 
for  all  x  £  D,  since  we  can  choose  yj  =  0  for  all  j  £  N.  Also  observe  that  the  validity  of  the  lower  and  upper 
inequality  in  (1.9)  for  all  y  £  U  are  respectively  equivalent  to  the  conditions  that 


^2  <  a(x)  -  u  X  £  D, 

3>  1 

(1.10) 

^2  \'llJji.x)\  5s  R  ~  d(x),  x  £  D. 

3>  1 

(1.11) 
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1.2  Previous  results 


In  the  paper  [9],  we  have  established  several  results  concerning  the  smoothness  and  approximation  of  the 
function  y  i— >  u{y)  by  multivariate  polynomial  in  y  with  coefficients  in  V .  To  describe  these,  we  introduce 
the  following  standard  multivariate  notation.  We  denote  the  countable  set  of  “finitely  supported”  sequences 
of  nonnegative  integers  by 


So 


T  :=  {v  =  (z/i,  v 2, . . :  i/j  £  N,  and  Vj  ^  0  for  only  a  finite  number  of  j}. 


-Ei 

i>i 


(1.12) 

(1.13) 


is  finite  if  and  only  if  v  £  T .  For  v  £  T  supported  in  {1, . . . ,  J},  we  define  the  partial  derivative 


dvu  = 


0M  u 

dVlyi .  ..dvJyj' 


and  the  multi-factorial 


v\  \=  Uj\  where  0!  :=  0. 

j>  i 


If  a  =  (aij)  j> i  is  a  sequence  of  complex  numbers,  we  define  for  all  v  £  T 

a- 

3>  1 

where  throughout  the  paper  we  use  the  convention  0°  :=  1.  We  are  interested  in  the  convergence  towards 
u(y)  of  the  power  series 

E  v e  u,  (i.i4) 

where  the  Taylor  coefficients  t„  £  V  are  defined  as 


We  define  the  sequence 


tv:=-^-dvu{ 0),  v  £  T . 

,  n  \  i  Wjh^iD) 

b  ■  •  1,  bj  :=  - - - : 


(1.15) 


where  amin  :=  infa,eD  a(x).  A  first  set  of  results  of  [9]  shows  that  under  UEA(r,  R),  all  partial  derivatives 
of  u  with  respect  to  y  are  well  defined  for  all  y  £  U,  and  satisfy  the  estimate 


Wu(y)\\v  < 


i>n( 

3>  1 


11^. 


'j\\L°°(D)Yi 


i  (y) 


where  am-m(y)  :=  inf^gu  a(x,  y).  Since  amjn(0)  =  amin,  this  estimate  implies  in  particular 

Mv<Mki\4r 


(1.16) 


(1.17) 


A  second  set  of  results  deals  with  the  summability  properties  of  sequences  of  the  type  ( J— Vbv  )  appearing 

V  v ■ 

in  the  above  estimates.  These  summability  properties  are  closely  linked  with  those  of  the  sequence  b  as 
expressed  by  the  following  result  of  [9]. 
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Theorem  1.1  For  0  <  p  <  1,  G  tp(T)  if  and  only  if  (i)  J2j>i  bj  <  1>  and  (h)  ( bj )  G  £P(N). 

Combining  this  result  with  the  estimate  (1.17),  we  find  as  an  immediate  corollary  that  if  the  sequence  b  is 
such  that  J2j> l  bj  <  1  and  (bj)  €  fp(N)  for  some  0  <  p  <  1,  then  the  sequence  (||t!y||v')!/e^  belongs  to  ip(T). 
In  other  words,  under  the  condition  that  X^>i  bj  <  1,  the  sequence  (||f„|| v)v£F  inherits  the  summability 
(or  sparsity)  of  the  sequence  (||V’j||L~(D))j>i  (since  (bj)  €  £P(N)  if  and  only  if  (\\ifj\\L°°(D))j>i  €  £P(N)).  In 
particular,  since  it  is  assumed  p  <  1  we  have  (||fI/||)„e.F  €  ^(T)  which  implies  that  the  power  series  (1.14) 
is  summable  in  V  uniformly  in  y  G  U  and  that  the  sum  of  this  series  is  indeed  u(y). 

Let  us  make  some  remarks  about  these  results  which  will  help  to  better  understand  the  motivation 
of  the  present  paper.  First  of  all,  the  good  news  in  this  theorem  is  that  it  shows  that  u(x,  y)  can  be 
uniformly  recovered  for  all  y  G  U  by  retaining  a  controlled  number  of  terms  of  the  expansion  (1.14).  Namely, 
(IMk)  G  £P(F)  implies  that  for  each  N  >  0,  there  is  a  finite  set  A at  C  T  with  #( Ajv)  =  N  (corresponding 
to  indices  of  N  largest  ||t„||y)  that  satisfies 

sup  \\u(y)~  Y  tvyv\W  <  Y  IMk  <  s:=--l.  (1.18) 

vGU  veAN  p 

The  proof  of  the  second  inequality,  originally  due  to  Stechkin,  is  recalled  in  Section  3.3  of  this  paper.  In 
other  words,  all  of  the  solutions  to  the  family  of  parametric  problems  can  be  simultaneously  approximated  by 
a  polynomial  in  y  with  coefficients  in  V  with  a  control  on  the  number  of  terms  in  the  polynomial  expansion. 
We  have  obtained  an  algebraic  convergence  rate  even  when  the  number  of  involved  parameters  is  infinite, 
showing  that  our  approximation  is  not  prone  to  the  curse  of  dimensionality. 

Another  important  point  is  that  the  assumption  (||V,jlU00(u))j>i  £  ^P(N)  is  quite  reasonable.  It  would  be 
implied  by  mild  regularity  assumptions  on  the  coefficients  a(x,y)  with  respect  to  the  x  variable.  Consider, 
for  example,  univariate  problems  on  D  =]  —  1, 1[  and  the  case  of  a  Fourier  expansion, 

a(x,  y)  =  a(x)  +  ^  y2k+i&k  cos(27 vkx)  +  ^  y2kPk  sin(27r kx) 

k> o  fc>l 

where  (a,k)k> o  and  (Pk)k> l  are  certain  normalizing  sequences.  It  is  known  that  if  the  function  a(-,y)  —  a  is 
in  Lip(s,L1)  for  some  s  >  1,  then  its  Fourier  coefficients  satisfy  the  decay  estimate 

\V2k+iO!k\  +  \V2kPk\  <  C\k\~s,  k>  1,  y  G  U 

with  C  depending  on  the  Lip(s,  Ll  )-norm  of  a(-,  y)  —  a.  Assuming  that  this  norm  is  bounded  independently 
of  y  which  is  arbitrary  in  U,  this  is  equivalent  to  the  decay  estimate 

\ak\  +  \Pk\<C\k\~s,  k>  1, 

and  therefore 

IIVblMo  <Cj~s,  j>  l,  (i.i9) 

after  suitably  reindexing  the  Fourier  basis  elements.  Therefore,  the  £P(N)  summability  of  the  sequence  (bj)j> i 
is  ensured  when  s  >  A  Results  like  this  persist  for  higher  space  dimension  d,  general  domains  and  other 
bases  such  Karhunen-Loeve  (e.g.  [21,  20])  and  wavelet  expansions. 

On  the  negative  side,  the  assumption  that  Ylj> i  bj  <  1,  which  is  equivalent  to  1  ||V,il|L~(D)  <  ^min 
is  quite  strong.  Indeed,  it  implies  UEA(r,  R)  with  r  :=  amin  —  5Zj>i  Wrfj  I|l°°(d)  >  0  and  R  =  + 

Ej>i  UoWl  °°(D)  <  +oo,  but  it  could  be  quite  stronger  than  UEA(r,  R).  This  is  in  particular  the  case  when 
the  supports  of  the  ipj  have  some  disjointness,  such  as  in  the  wavelet  case  where  only  a  few  of  the  wavelets 
overlap  at  a  given  scale,  or  in  the  case  of  characteristic  functions  of  disjoint  sets. 
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1.3  Objective 

This  brings  to  the  forefront  the  question  of  whether  the  property  that  the  sequence  (||t1/||v)j/eJr  belongs 
to  lp(T)  might  hold  under  the  weaker  and  more  natural  UEA(r,  R).  Closely  related  is  the  question  of 
approximating  u(y)  in  (1.14)  by  partial  sums:  for  finite  sets  A  C  T  and  y  G  U,  we  define 

S\u(y)  :=  ^2  tvyv  G  V  (1.20) 

We  say  that  a  sequence  (An)n>i  C  T  of  finite  sets  exhausts  T  if  any  finite  A  C  T  is  contained  in  all  Ajv 
for  N  >  No  with  Nq  sufficiently  large.  One  purpose  of  the  present  paper  is  to  prove  the  following  theorem. 

Theorem  1.2  Ifa(x,y)  satisfies  UEA(r,  R)  and  if  (\\ipj  ||l°o(£>)).j>i  G  £P(N)  for  some  p  <  1,  then 

u(y)  =  ^2  tvyV  ^  y  G  U'  (^i) 

where  the  functions  tu  G  V  are  as  in  (1.14)  and  (||£i/||v)i/e:F  G  fP[fF)  for  the  same  value  of  p.  The  convergence 
in  (1.21)  is  to  be  understood  in  the  following  unconditional  sense:  if  (An)n>i  C  T  is  any  sequence  of  finite 
sets  which  exhausts  tF,  then  the  partial  sums  S\Nu(y)  =  satisfy 

lim  sup  ||u(y)  -  SAjvu(t/)||y  =  0.  (1.22) 

N^+ooy<zjj 

If  An  is  the  set  of  v  G  T  corresponding  to  indices  of  N  largest  ||t^||v,  we  have  in  addition  the  convergence 
rate  estimate 

sup\\u(y)  -  SANu(y)\\v  <  ||(||ti,||y)||^(^)A“s,  s  -  1.  (1.23) 

veu  P 

Similar  to  the  results  in  [9],  this  theorem  reveals  that  the  sequence  (||£„ \\v)v£F  inherits  the  summability 
properties  of  the  sequence  (HV’j ||i°o(D))j>i)  however  now  under  the  weaker  assumption  UEA(r,  R).  The 
proof  of  Theorem  1.2  requires  much  finer  estimates  on  the  ||£^||v  than  (1.17)  which  was  used  in  [9].  Our 
key  ingredients  for  getting  such  estimates  rely  on  complex  analysis.  More  precisely,  we  extend  the  definition 
of  u(y)  to  u{z)  for  the  complex  variable  z  =  {zj)j> i  (by  using  the  Zj  instead  of  yj  in  the  definition  of  a  by 
(1.8))  where  each  Zj  has  modulus  less  than  1.  Therefore  2  belongs  to  the  polydisc 


U  :=  G  C  :  \zj\  <  1}.  (1-24) 

Using  (1.10)  and  (1.11),  it  is  readily  seen  that  when  the  functions  a  and  ipj  are  real  valued,  then  UEA(r,  R) 
implies  that  for  all  x  G  D  and  2  G  U, 

0  <  r  <  9?(a(a:,  z))  <  \ a(x,  z)\  <  2 R,  (1-25) 

and  therefore  the  corresponding  solution  u(z)  is  well  defined  in  V  for  all  2  G  W  according  to  the  complex 
valued  version  of  Lax-Milgram  theorem.  More  generally,  we  may  as  well  consider  an  expansion  of  the  form, 

a(x,  z)  =  a  +  '^2  zj'lPj 
j>  i 

where  a  and  ifj  are  complex  valued  functions  and  replace  hypothesis  UEA(r,  R )  by  its  complex  valued 
counterpart. 
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Uniform  Ellipticity  Assumption  in  C  :  there  exist  0  <  r  <  R  <  oo  such  that  for  all  x  G  D  and 
all  z  GU 

0  <  r  <  z))  <  | a(x,  z)\  <  R  <  oo.  (1-26) 

We  refer  to  (1.26)  as  UEAC(r,R).  We  will  prove  the  following  complex  valued  version  of  Theorem  1.2, 
which  clearly  implies  it  as  a  particular  case. 

Theorem  1.3  If  a(x,z)  satisfies  UEAC(r,i?)  for  some  0  <  r  <  R  <  oo,  and  if  (\\ipj\\L°°(D))j>i  €  fp(N) 
for  some  0  <  p  <  1,  then  for  all  z  GU 

u(z)  =  tvzv  in  V,  (1-27) 

where  tv  GV  and  (||f;,||y)i,ejr  G  IV[T)  for  the  same  value  of  p.  The  convergence  in  (1.27)  is  to  be  understood 
in  the  following  unconditional  sense:  if  (I^n)n>i  is  any  sequence  of  finite  sets  which  exhausts  T,  the  partial 
sums  SAnu(z)  =  X^eAiv  tvZ,V  satisfv 

lim  sup  | \u(z)  -  Sanu(z)\\v  =  0.  (1.28) 

AT^+oo  zeU 

If  in  addition  A  at  is  the  set  of  v  G  T  corresponding  to  indices  of  the  largest  ||L,||y,  we  have  the  convergence 
estimate 

sup  IHz)  -  SAjvu(2)||y  <  IKIMIvOII^^-N'-*,  s:—  1-  (1-29) 

zGU  P 

1.4  Outline  of  the  paper 

The  analyticity  of  u  with  respect  to  the  variable  2  is  discussed  in  §2,  in  which  we  use  Cauchy’s  integral 
formula  to  derive  a  general  estimate  of  the  form 

iwivs^ntf. 

3>  1 

where  5  >  0,  and  where  is  any  sequence  of  positive  numbers  such  that 

"^2  Pj\'tl;j(x)\  —  5?(«(2:))  —  8,  x  G  D. 
j>  i 

In  order  to  prove  the  main  Theorem  1.3,  we  introduce  in  §3  a  particular  choice  of  p  =  {pj)j>i  that  depends 
on  v  and  satisfies  the  above  constraint  with  S  =  r/2,  leading  to  a  corresponding  estimate  for  ||f„||y.  We 
then  use  this  estimate  in  order  to  prove  the  £p  summability  of  the  sequence  (||t^||y)y6jp. 

There  is  also  interest  in  the  validity  of  expansions  like  (1.21)  when  the  monomial  basis  zv  is  replaced 
by  other  polynomial  bases.  For  example  in  the  analysis  of  stochastic  elliptic  problems,  certain  polynomial 
bases  (depending  on  the  underlying  probability  measure  describing  the  stochasticity)  may  lead  to  improved 
results.  This  is  discussed  in  [9]  where  for  example  it  is  shown  that  a  tensor  product  Legendre  polynomial 
basis  gives  improved  results  if  the  underlying  probability  measure  is  Lebesgue  measure  and  if  we  agree  to 
measure  distortion  in  a  least  squares  sense.  The  improvement  comes  in  the  form  that  the  assumptions  on 
the  summability  of  ( || II ( z?) ) l  f°r  a  given  convergence  rate  N~s  are  weaker.  Motivated  by  this,  we 
show  in  §4  that  a  version  of  Theorem  1.3  holds  with  respect  to  tensor  product  Legendre  expansions. 

The  approximation  of  u  by  its  partial  sum  S\N  u(y)  is  described  by  the  data  of  N  =  #(Ajv)  functions  tv  G 
V .  In  practical  numerical  computations,  these  functions  are  themselves  approximated  by  space  discretization 
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in  the  x  variable,  for  instance  using  the  Finite  Element  method.  We  discuss  in  §5  the  additional  error  resulting 
from  such  discretizations.  For  this  purpose  we  introduce  a  smoothness  space  W  C  V  that  governs  the  rate 
of  convergence  of  Finite  Element  methods,  and  we  study  the  £p  summability  of  the  W  norms  of  the  Taylor 
and  Legendre  coefficients.  Based  on  this  analysis,  we  introduce  a  specific  choice  of  Ajv  and  of  Finite  Element 
spaces  Vv  that  depend  on  v  £  An,  and  we  study  the  approximation  of  u  by  a  truncated  Taylor  series 
^y1'  with  coefficients  tv  picked  from  the  Vv  spaces,  as  well  as  by  truncated  Legendre  series  with 
coefficients  picked  in  the  Vv  spaces.  We  show  that  the  convergence  rate  in  terms  of  the  total  number  of 
degrees  of  freedom  N,i0f  =  dim(K,)  is  either  the  same  as  when  approximating  a  single  instance  u(y) 

in  the  V  norm,  or  as  when  approximating  u  without  space  discretization. 

In  the  present  work,  we  only  consider  the  model  problem  (1.1)  and  the  situation  where  the  coefficients 
depend  on  the  parameters  in  an  affine  manner.  We  expect  that  our  general  approach  based  on  analyticity 
can  be  useful  for  more  general  problems  with  smooth  yet  not  necessarily  affine  parameter  clependance. 

Let  us  finally  stress  that  the  main  objective  of  this  paper  is  to  establish  approximation  results,  not  to 
propose  a  specific  algorithm  for  computing  such  approximations.  Our  results  should  therefore  be  considered 
as  a  benchmark  for  the  convergence  analysis  of  numerical  methods  for  the  approximation  of  parametric  and 
stochastic  PDE’s  in  the  x  and  y  variables.  The  two  most  commonly  used  numerical  methods  are  Galerkin 
projection  [4,  22]  and  collocation  [3,  18,  19].  In  order  to  retrieve  the  same  convergence  rates  which  are  proved 
in  the  present  paper,  such  methods  need  to  be  developed  within  an  adaptive  framework,  with  the  goal  of 
selecting  proper  sets  An  and  finite  element  spaces  Vv  throughout  the  numerical  computation.  This  will  be 
the  object  of  future  work. 

2  Analyticity  of  u  and  estimates  of  Taylor  coefficients 

2.1  Domains  of  holomorphy 

Our  main  vehicle  in  proving  Theorem  1.3  is  to  exploit  the  fact  if  UEAC(r,  R)  holds,  then  the  map  2  i— >  u{z)  is 
a  V  valued  and  bounded  analytic  function  in  certain  domains  which  are  larger  than  IA.  For  0  <  <5  <  2 R  <  oo 
we  define  the  set 


As  =  {z  £  CN  :  d  <  5f(a(a;,  z))  <  \a(x,z)\  <  2 R  for  every  x  £  D.j  (2.1) 

Clearly,  if  UEAC(r,  R)  holds  and  if  0  <  6  <  r,  then  As  contains  U.  According  to  the  Lax-Milgram  theorem, 
we  also  find  that  for  all  z  £  As,  there  exists  a  unique  solution  u(z)  £  V  which  satisfies 

\\u(z)\\v<1^.  (2.2) 

Our  first  interest  is  to  establish  holomorphy  of  the  map  z  i— >  u(z)  with  respect  to  the  countably  many 
variables  Zj.  This  fact  stems  from  the  observation  that  the  function  u(z)  is  the  solution  to  the  operator 
equation  A(z)u(z)  =  /,  where  the  operator  A(z)  £  C(V,  V*)  depends  in  an  affine  manner  on  each  variable 
Zj.  To  make  our  presentation  more  self-contained  we  give  a  direct  proof.  We  start  from  a  stability  result, 
which  is  also  used  further  in  this  section. 

Lemma  2.1  If  u  and  u  are  solutions  of  (1.2)  with  the  same  right  hand  side  f  and  with  coefficients  a  and 
a,  respectively,  and  if  these  coefficients  both  satisfy  the  assumption  (1.5),  then 


ll/ll 


V* 


r2 


II 


ll«-«lk  ^ 


a  —  a||ioo(£)). 


(2.3) 


Proof:  Subtracting  the  variational  formulations  (1.2)  for  u  and  u,  we  find  that  for  all  v  £  V, 
0  =  /«(x)V»(x).V»(x)(ix-/5WVi.V»(x)<fc 

D  D 

=  /  „(x)(V»(x)  -  VS(x))  •  V„(x)dx  +  I  (a  -  fi)(x)V»(x)  ■  V»(x)dx. 

D  D 

Therefore  w  =  u  —  u  is  the  solution  of 

J  a(x)Vw(x)  ■  Vv(x)dx  =  L(v)  where  L(v)  :=  J  (a  —  a)(x)Vu(x)  ■  Vv(x)dx. 


D 


D 


Hence 


M  v  < 


mw- 


and  we  obtain  (2.3)  since 


|y.  =  max  \L(v)\  <  \\a  -  d||i=o(jD) ||u||y  <  ||a  -  a\\L^{D) 

\\v  v=i  r 


(2.4) 


□ 


Lemma  2.2  At  any  z  £  Ag,  the  function  z  i— >  u(z)  admits  a  complex  derivative  dZju(z)  £  V  with  respect  to 
each  variable  Zj.  This  derivative  is  the  weak  solution  of  the  problem:  for  z  £  As,  find  dZju(z)  £  V  such  that 

J  a(x,  z)VdZju(x,  z)  •  Vv(x)dx  =  Lq(v)  :=  —  J  ipj(x)X7u(x,  z)  ■  Vv(x)dx,  forallv£V.  (2-5) 


D 


D 


Proof:  We  fix  j  >  1  and  z  £  ^4^.  We  denote  by  e,j  the  Kronecker  sequence  with  1  at  index  j  and  0  at  other 
indices.  For  h  £  (C  \  {0}  we  consider  the  difference  quotient 


Wh{z)  = 


u(z  +  hej)  —  u(z) 


£  V  . 


(2.6) 


We  notice  that  this  quotient  is  well  defined  for  h  sufficiently  small:  if  |^|||Vb'l|.L°o(D)  <  f,  we  clearly  have 

S  5 

-  <  3t(a(x,  z  +  hej))  <  |a(x,  z  +  hej) \  <2 R  +  x  £  D, 

and  therefore  u(z  +  hej)  is  well  defined  as  an  element  of  V.  For  such  sufficiently  small  values  of  h,  we  have 
for  all  v  £  V, 

0  =  J  a(x,  z  +  hej)X7u(x,  z  +  hej)  ■  X7v(x)dx  —  J  a(x,  z)Vu(x,  z)  ■  Vv(x)dx 


D 


D 


h  J  a(x,  z)\7wh(x,  z)  ■  Vv(x)dx  +  J (a(x,  z  +  hej)  —  a(x,  z))Vu(x,  z  +  hej)  ■  Vv(x)dx 


D 


D 


h  J  a(x,  z)Vwh(x,  z)  ■  Vv(x)dx  +  h  J  tpj(x)\/u(x,  z  +  hej)  ■  X7v(x)dx 

D  D 
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and  therefore  Wh  is  the  unique  solution  to  the  variational  problem 

J  a(x,  z)Vwh(x,  z)  ■  X7v(x)dx  =  Lh(v),  for  all  v  £  V, 

D 

where  Lh  :  v  — >  Lh(v)  :=  —  f  ipj'Vu(z+hej)-'Vv  is  a  continuous,  linear  functional  on  V.  The  linear  functional 

D 

Lh(-)  varies  continuously  in  V*  with  h  as  h  tends  to  0:  indeed,  we  have  for  all  v  £  V, 

\Lh(v)  -  L0(v) |  =  |  J  'ipj(x)(\7u(x,z  +  hej)  -  Vu(x,z))  •  Vv(x)dx\  <  \\^j\\L-{D)\W{z  +  hej)  -  u(z)\\v\\v\\v , 

D 

and  since  the  stability  estimate  (2.3)  implies 

|| u(z  +  hej)  -  u{z)\\v  =  || Vu(z  +  hej)  -  S7u(z)\\L2{D)  <  |fe|||^illL°°(D)4^fV  , 

it  follows  that  L ^  converges  towards  L0  in  V*  as  h  — >  0.  Therefore  Wh  converges  in  V  towards  wq,  which  is 
the  solution  to 

/  a(x,  z)'Vwq(z)  ■  Vi>  =  Lo(v),  for  all  v  €  V. 

D 

Hence  dZju(z )  =  Wq  exists  in  V  and  is  the  unique  solution  of  the  variational  problem  (2.5).  □ 

We  further  note  that  .4,$  also  contains  certain  polydiscs.  Let  p  :=  (pj)j> i  be  a  sequence  of  positive 
numbers  and  define 

Up  =  ®j>i{zj  e  C  :  \zj\  <  Pj}  =  {Zj  €  C  :  z  =  i  ;  |^|  <  pj}.  (2.7) 

We  say  that  a  sequence  p  =  {ftj)j>\  is  5 -admissible  if  and  only  if  for  every  x  €  D 

^Po\ipj{x)\  <  $t(d(x))  -  6.  (2.8) 

i>  i 

If  the  sequence  p  is  5-admissible,  then  the  polydisc  Up  is  contained  in  Ag.  Indeed,  we  have  on  the  one  hand 
for  all  z  £  Up  and  for  almost  every  x  £  D 

$t(a(x ,z))  >  9t(a(x))  -  kjV’jWI  >  3?(a(a;))  -^Pj \ipj(x)\  >  6 , 
j>  i  j>  i 

and  on  the  other  hand,  for  every  x  £  D 

|a(x,  z) |  <  |a(a’)|  +  \zjtjjj(x)\  <  |a(x)|  +  9?(a(a;))  —  5  <  2|o(a;)|  <  2R, 
j>  i 

where  we  have  used  the  bound  |o(a;)|  <  R  which  is  a  trivial  consequence  of  UEAC(r,  R). 

Similar  to  (1.10),  we  notice  that  the  validity  of  the  lower  inequality  in  (1.26)  for  all  z  £  U  is  equivalent 
to  the  condition  that 

\ipj(x)\  <  5f(a(x))  —  r,  x  £  D.  (2-9) 

j>  i 

This  shows  that  the  constant  sequence  pj  =  1  is  ^-admissible  for  all  0  <  <5  <  r,  and  that  for  S  <  r  there  exist 
(5-admissible  sequences  such  that  pj  >  1  for  all  j  >  1,  i.e.  such  that  the  polydisc  Up  is  strictly  larger  than  U 
in  every  variable. 
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2.2  Convergence  of  the  polynomial  expansion  of  u(z) 

As  a  first  consequence  of  these  observations,  we  prove  convergence  of  the  series  towards  the 

function  u{z)  for  a  specific  summation  process ,  under  the  condition  that  the  series  defining  a(x,  z )  converges 
in  L°°(D )  uniformly  over  z  €  U. 


Proposition  2.3  //UEAC(r,R)  holds  for  some  0  <  r  <  R  <  oo  and  if 


sup  ||a(-,  z)  —  a(-)  —  V  Zjif)j(-) ||  (£>)->  0  as  J  ->  oo 

Z&A  i  <j<J 

then  there  exists  a  sequence  of  (A*n)n>i  of  finite  subsets  which  exhausts  T  and  such  that 

lim  sup  \\u(z)  -  SA*  u{z)\\v  =  0. 

N->+oo  2g u 

Proof:  For  any  N  >  0,  there  exists  J  =  J(N)  large  enough  such  that 


(2.10) 


sup  ||o(-,  z)  —  a(-)  —  < 


zGU 


1  <j<J 


2  TV 


|v* 


(2.11) 


For  such  a  J  and  z  GU,  we  define  the  set  Ej  =  {1, . . . ,  J}  and  Zej  which  is  obtained  from  z  by  putting  to 
0  all  entries  Zj  for  j  >  J  and  leaving  them  unchanged  for  j  <  J.  Therefore  (2.11)  is  equivalent  to 


1  r2 

sup  ||a(-,  z)  —  a(-,  zEj)\\l°°(D)  <  w^trFT~ 
zGU  21V  \\f\\v* 


We  then  define 


uj(zi,...,zj)  =u{zEj) 

Combining  (2.12)  with  the  stability  estimate  of  Lemma  2.1,  we  find  that  for  all  z  £  U 


(2.12) 

(2.13) 


||w(z)  -Uj(zl,...,zj)\\v  < 


r*  1 


1 


r2  21V||/||y,  2  N‘ 


On  the  other  hand,  we  have  seen  that  the  function  uj  is  holomorphic  in  an  open  neighbourhood  of  the  J- 
dimensional  polydisc  ®i <j<j{zj  G  C  :  \zj\  <  1}.  From  standard  results  on  Banach  space  valued  holomorphic 
functions  (see  Proposition  3.5  of  [12]  or  Theorem  2.1.2  of  [15]),  this  implies  its  analyticity  and  therefore  the 
uniform  summability  of  its  Taylor  series  on  this  polydisc.  Therefore  there  exists  K  =  K(N )  large  enough 
such  that  if  we  set 

:=  {v  G  T  ;  \v\  <  I\  and  {j  :  Vj  0}  C  Ej}, 

we  have  ^ 

sup  \\uj(zi, . . . ,  zj)  —  5a^u(^)||v*  <  — , 
z£U  21V 

where  we  use  the  fact  that  Sa*nu(z)  =  Sa*nuj(z\,  . . . ,  zj)  since  A^  C  Ej.  Combining  both  estimates  we 
obtain  that  ^ 


sup  H*)  -Sa*K*)||v  < 

z£U  A 


which  proves  convergence.  The  exhaustion  property  of  the  A^  is  ensured  by  assuming  that  J(N)  and  K(N) 
are  strictly  increasing,  which  is  achievable  without  loss  of  generality.  □ 
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2.3  Estimates  of  the  Taylor  coefficients 

In  order  to  prove  Theorem  1.3,  we  need  estimates  of  the  |  tv\W-  These  are  given  by  the  following  result. 

Lemma  2.4  If  UEAC(r,  R)  holds  for  some  0  <  r  <  R  <  oo  and  if  p  =  (pj)j> i  is  a  S-admissible  sequence 
for  some  0  <  6  <  r,  then  for  any  v  €  T  we  have  the  estimate 

IIMk  <  n  p7j  =  — P-".  (2-14) 

j>  1 

where  we  use  the  convention  that  t~°  =  1  for  any  t  >  0. 

Proof:  Let  v  =  (vj)j> i  G  T  and  let  J  =  max{j  G  N  :  Vj  ^  0}.  Recalling  the  function  uj  defined  by  (2.13), 
we  therefore  have 

From  the  assumption  that  p  is  (5-admissible,  we  have  that 

\\uj(zi,...,zj)\\v<^^,  (2.15) 

for  all  (zi, . . . ,  Zj)  in  the  J-dimensional  polydisc 

UP,j  ■=  ®\<j<j{zj  €  C  :  \zj\  <  pj}.  (2.16) 

Introducing  the  sequence  p  defined  by 

£ 

Pj  =  Pj  +  z  if  3  <  J >  Pj  =  Pj  if  3  >  J,  £  :=  - > 

2 1|  hj<j  \Vj\\\L°°(D) 

it  is  easily  checked  that  p  is  ^-admissible  and  therefore  Up  C  As.  We  thus  infer  from  Lemma  2.2  that  for 
each  z  €  Up,  u  is  holomorphic  in  each  variable  zr 

It  follows  that  uj  is  holomorphic  in  each  variable  Z\,...,Zj  on  the  polydisc  ®i<j<j{\zj\  <  pj}  which  is 
an  open  neighbourhood  of  Up,j.  We  may  thus  apply  the  Cauchy  formula  (Theorem  2.1.2  of  [15])  recursively 
in  each  variable  Zj  and  write 


Uj(z!,...,zj)  =  (2ni)  J  J  ...  J 


|zi|=Pl  \zj\=PJ 


Ujjz^-.^Zj) 

(Zx  -  Zi)  .  .  .  ( Zj  -  Zj) 


fz\  .  .  .  dzj. 


By  differentiation,  this  yields 

0M 

dzf1 . . .  ozy 


uj(0,...,0)  =  u\(2m)  J  j  ...  j 


|zi|=Pl  \zj\=pj 


Uj{Z!,...,Zj) 

- iphj  dz% ...  dzj , 

zi  ■■■z J 


and  therefore,  using  (2.15),  we  obtain  the  estimate 

aM  Uj 


dzf1  . . .  dzv/ 


(0,...,0) 


,  ,  /  V*  TT  ~Vj 

j<J 


which  is  equivalent  to  (2.14). 


□ 
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For  a  given  v  £  J7,  we  may  search  for  the  best  bound  provided  by  Lemma  2.4.  This  bound  is  given  by 


||tJ|  <  inf  1  inf  Ip  v  ;  p  is  5-admissible} 

0<S<r  ^  0 

The  infimum  is  not  easily  computable.  In  particular,  for  a  given  d  such  that  0  <  S  <  r,  the  minimization 
problem 

inf  {p~u  p  is  d-admissible}, 

does  not  have  a  simple  explicit  solution  due  to  the  form  of  the  constraint 


^2pj\ipj(x)\  -  6,  xGD, 

j>  i 


that  generally  couples  all  values  of  pj.  Only  in  the  particular  case  (1.7)  where  the  have  disjoint  supports, 
one  may  decouple  the  search  of  the  optimal  pj  which  is  then  given  by 


p,  =  mm  ■ 

J  xGD 


$i(a(x))  —  8 


Note  that  in  this  case,  the  optimal  sequence  p*  is  independent  of  v.  In  the  general  case  where  the  supports 
of  ipj  overlap,  the  optimal  sequence  p*  should  vary  with  v. 

Since  this  optimal  sequence  is  not  accessible  to  us,  our  strategy  for  proving  Theorem  1.3  is  to  carefully 
design  for  each  v  a  certain  sequence  p  =  p(v)  which  satisfies  the  constraint  of  ^-admissibility,  and  use  the 
resulting  estimate  in  order  to  prove  that  (||t„||y)i/e;F  G  £P(F). 


3  Proof  of  Theorem  1.3 


3.1  A  choice  of  ^-admissible  sequences 


From  now  on,  we  work  with  the  particular  choice 
the  form 


IMk  < 


2||/lk* 


8  =  Therefore,  the  estimate  (2.14)  of  Lemma  2.4  takes 


Upj 


2II/II 


(3.1) 


for  all  ^-admissible  sequence  p. 

Given  v  G  IF,  we  have  at  our  disposal  the  ability  to  choose  the  sequence  p  tailored  to  v  as  long  as  it  is 
^-admissible.  To  begin  this  choice,  we  first  choose  Jq  large  enough  such  that 


^  (3.2) 

j>Jo 


Such  a  Jo  exists  under  the  assumptions  of  Theorem  1.3  because  (||'0illi~(£)))i>i  G  £p  C  t1.  Note  that  we 
may  always  assume  (and  will  do  so  in  what  follows)  that  up  to  some  reindexing  of  the  basis  elements  ipj  the 
sequence  (||V’ilk00)i>i  is  non-increasing.  We  first  split  N  into  the  two  sets  E  :=  {1  <  j  <  J0}  and  F  := 
N\E.  Next  we  choose  k  >  1  such  that 

(«  -  !)  y  Hjh-(D)  <  (3-3) 

3<Jo 

For  our  given  v  we  shall  use  the  sequence  p  defined  by 

TV  ■ 

Pj  :=  k,  j  €  E;  Pj  :=  max{l,  - — \ - },  j  G  F  (3.4) 
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where  we  use  the  notation  ve  for  the  restriction  of  v  to  a  set  E  and  as  before  |  •  |  denotes  the  l1  norm  so 
that  \vp\  '■=  Ej>j0  y:i ■  We  also  make  the  convention  that  =  0  when  \uF\  =  0.  Let  us  verify  that  the 
sequence  p  defined  in  (3.4)  is  ^-admissible.  To  do  so,  we  estimate  for  every  x  £  D 

E  p* i ^ (x) i  ^  k  E 1 Tpj (x) i  +  E  max{1>  ..I,,  ml^i —  }i 4*3 (x) i 


<  («- 4)  E  HAx)\  +  X]  i ^Ax)\  +  E  i^'(a;)i  +  \ 

j<Jo  j<Jo  j>Jo 

^  i+Ei^(*)i  +  i 
m 


<  3 ?(a(a;))  —  §, 


where  the  last  inequality  uses  (2.9)  which  follows  from  UEAC(r,  /?,).  The  bound  (3.1)  is  therefore  valid  for 
this  particular  sequence  p ,  and  it  can  be  rewritten  as 


\tv\\v  < 


2||/|| 


v 


■(n^)(n( 


I  yF\dj 


jGE 


Ua 

jGF  1 


(3.5) 


where  r/  :=  1  <1  and 


dj  := 


4IIV’jlk» 


In  the  second  product  on  the  right  hand  side  of  (3.5),  we  use  the  convention  that  a  factor  equals  1  if  Vj  =  0. 
Observe  that  from  (3.2),  we  have 

IMII<»  =  E  dj  <  (3-6) 

j>Jo 


3.2  Proof  of  £p-summability 

The  estimate  (3.5)  has  the  general  form 


\\tu\\v  <  Cra{vE)  0(vf)- 


(3.7) 


Let  Te  (respectively  Tf)  be  the  collection  oi  v  £  F  that  are  supported  on  E  (respectively  on  F).  Then,  for 
any  0  <  p  <  oo,  we  have 

E  HMiv  <  c^^eY^eY  =  crp(  E  «mp) ( E  Piy)p) =;  cpaeaf.  (3.8) 

v(zlJ-  vG.J'e  vSLJ-e 

In  our  particular  setting,  the  first  factor  AF  is  easily  estimated  by  factorization: 

=  E  a m"  =  E  II  ’T’  =  ILE  1"")  =  (ivb)  <  °°-  <3-9> 

i/GFe  v€.J~e  j£E  n>0 


So  we  are  left  with  showing  that  Ap  is  finite.  In  our  particular  setting,  we  have 


j£F 


Uf\ 


n 


jeF  yj 


(3.10) 
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3.3  Summability  and  convergence  rate 

We  have  just  shown  that  the  sequence  (||t1/||i/)i,e.?-  is  in  tp{T)  and  therefore  in  £1(J7).  We  prove  unconditional 
summability  by  the  following  standard  argument. 

Let  (Ajv)at>i  be  a  sequence  of  finite  sets  which  exhausts  T .  We  recall  the  particular  sequence  (A*y)jv>i 
of  Proposition  2.3.  According  to  this  result,  we  know  that  for  all  e  >  0  there  exists  M  =  M(e)  such  that 

IK*)  -  Sa*mu(z)\\v  < 

for  all  z  £  U.  Since  (A^)at>i  exhausts  IF,  we  may  also  assume  that 

E  IMv<f. 

Since  {An)n>i  exhausts  T,  there  exists  N0  such  that  A^.  C  AN  for  all  N  >  N0.  It  follows  that  for  all 
N  >  No,  and  every  z  GU, 

IK*)  -  SAjvw(*)l|v  <  II u(z)  -  SaIjU^Wv  +  ||SAjv\a*N*)IIv  <  |  +  E  IMv  <  e- 

am 

The  convergence  rate  estimate  (1-29)  is  obtained  by  writing  for  any  z  GU 

IN*)  -  E  t^Wv  <  E  HMIv<  E 

veAj,  jy^Ajv  n>N 
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where  An  is  the  set  of  is  £  T  corresponding  to  indices  of  the  largest  ||t„||y  and  where  (7„)n>i  is  the  decreasing 
rearrangement  of  the  ||f„||y.  We  then  use  the  observation  due  to  Stechkin  that  for  any  0  <  p  <  q  <  oo  and 
any  TV  £  N 

n>N  n> 1 

For  q  <  oo  this  is  easily  proved  by  combining  the  two  estimates 

X  -  7 qNV  X^<  7  qNP  X  7n  and  N7n  <  X  7n  <  X  7n- 

n>N  n>N  n>  1  n<N  n>  1 


The  case  g  =  oo  is  a  straightforward  adaptation.  Using  (3.13)  with  g  =  1  and  0  <  p  <  1  we  obtain 


sup  IKz)  -  5AjvwWI|v  <  IV  KIMk)||p>(.r)» 

z€U 


l 

s  := - 1. 

P 


We  close  this  section  with  some  remarks  on  the  nature  of  Theorem  1.3.  This  theorem  states  that  whenever 
UEAC(r,  fi)  is  satisfied  and  if  (\\ipj\\L°°(D))j>i  €  £P(N)  for  some  0  <  p  <  1,  then  (||fj/||y)i/  £  Its 

norm,  ||(||£i/||y)||#>(.F)  is  the  constant  in  the  error  bound  of  best  TV-term  approximation.  It  depends  on 
r  and  on  the  sequence  IU°°(£>))j>i-  However,  inspection  of  the  proof  of  Theorem  1.1  of  [9],  shows 
that  this  error  bound  depends  on  the  sequence  {'4>j)j> i  not  only  through  its  norm  ||(||'f/,j||.L°°(.D))||p>(N)  as 
one  might  expect,  but  also  through  other,  rather  implicit  quantities  such  as  the  smallest  integer  J\  such 
that  J23>Jl  W^Pj IIl«=(d)  <  £  where  £  iR  turn  depends  on  r.  A  more  explicit  bound  only  in  terms  of  r  and 
ll(IIV’j||i00(D))IU*,(N)  can  be  obtained  if,  for  example,  (||f/,j||L~(D))i>i  G  ^9(N)  for  some  q  <  p  (see  Remark 
7.7  in  [9]). 


4  Tensorized  Legendre  expansions 

4.1  Statement  of  the  result 

In  this  section,  we  study  another  analytic  expansion  of  u  by  changing  the  monomial  basis  to  a  Legendre 
basis.  Our  motivation  for  doing  this  is  that  if  we  agree  to  measure  goodness  of  fit  in  a  least  squares  sense,  the 
Legendre  expansions  result  in  better  decay  estimates  for  TV  term  approximation  than  monomial  expansions 
(see  Theorem  4.1  below). 

We  will  consider  two  types  of  Legendre  expansions  which  differ  only  in  their  normalization  of  the  basis. 
In  one  variable,  the  Legendre  basis  (Pn)n> o  is  usually  defined  with  the  L°°  normalization 

\\Pn  ||  L°°  ([_  1,1])  =  Pn(  1)  =  1.  (4-1) 

We  also  consider  the  L 2  normalized  sequence  Ln(t)  =  \/2n  +  1  Pn(t),  which  satisifies 

1 

J  \Ln(t)\2j  =  l. 

-l 

It  is  important  to  note  that  L0  =  P0  =  1.  We  continue  with  our  multivariate  notation  from  the  previous 
sections.  For  is  £  P,  we  consider  the  tensorized  version  of  these  polynomials 

pAv)  ■=  Y[p*M  and  LAv)  :=  Y[lvM.  (4.2) 

j> i  j> i 
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Note  that  (L„)„6yr  is  an  orthonormal  basis  of  L2(U ,  dp)  where  dp  denotes  the  tensor  product  of  the  (probabil¬ 
ity)  measures  ^  on  [—1,1]  and  is  therefore  a  probability  measure  on  U  =  [— 1, 1]N.  The  probability  measure 
dp  on  U  induces  for  0  <  p  <  oo  the  measurable  spaces  Lp(U,dp),  and  the  Bochner  spaces  Lp{U,V,d /i)  of 
^(-measurable  mappings  from  U  to  V  which  are  p-summable.  We  use  these  spaces  for  p  =  2  and  for  p  =  oo. 

In  contrast  to  the  monomial  expansion,  we  restrict  our  study  to  the  approximation  of  u(y)  by  tensorized 
Legendre  series  in  U.  We  shall  however  make  use  of  the  analytic  dependence  of  u(z)  on  z  in  the  estimation 
of  the  Legendre  coefficients.  Since  u  £  L°°{U.  V.  dp)  C  L2(U,V,dp),  it  admits  unique  expansions 


i(y)  =  u^p^v)  =  wMy), 


that  converge  in  L2(U,  V,  dp),  where  the  coefficients  u„,  vv  €  V  are  defined  by 


vv  :=  J  u{y)Lv{y)dp{y)  and  uv  :=  (jj(l  +  2  vv. 


i>i 

The  following  theorem  is  the  analog  to  Theorem  1.3  for  Legendre  expansions. 


(4.3) 


(4.4) 


Theorem  4.1  If  a(x,z)  satisfies  UEAC(r,  R)  for  some  0  <  r  <  R  <  oo  and  if  (||V,llk00)j>i  £  tp(N)  for 
some  p  <  1,  then  the  sequences  (||w„ ||y)„6;F  and  (HwllvhejF  belong  to  IP(T)  for  the  same  value  of  p.  The 
Legendre  expansions  (4.3)  converge  in  L°°(U,V)  in  the  following  sense:  if) An)n>i  is  any  sequence  of  finite 
sets  which  exhausts  T  then  the  partial  sums  S\Nu(y)  :=  uf{x)Pv{y)  =  vv)x)Lv(;y)  satisfy 


lim  sup  ||u(y)  -  SANu)y)\\v  =  0.  (4.5) 

N^+ooyeU 

If  An  is  the  set  of  v  £  IF  corresponding  to  indices  of  the  largest  ||  u„||y,  we  have  in  addition  the  convergence 

estimate  ^ 

sup  ||«(y)  -  S'Ajvu(t/)||y  <  ||(||wt/||y)||^(^)iV_s,  s  :=  -  -  1.  (4.6) 

veu  P 

If  An  is  the  set  of  v  £  IF  corresponding  to  indices  of  the  largest  ||tv||y,  we  have  the  convergence  estimate 

||«  —  SANu\\L2^uvdtl)  <  ||(||uI/||y)||^(^r)iV_s,  s:=p~2'  (4-7) 


4.2  Estimates  of  the  Legendre  coefficients 

In  order  to  prove  their  IP)T)  summability  we  estimate  the  quantities  ||u„||y  and  ||u„||y.  By  (4.4), 

1 

ll^lk  =  (n(1  +  2^))'l|w||y,  V£T.  (4.8) 

j>  i 

Therefore  the  ||u,y||y  <  v'  and  it  will  be  sufficient  to  prove  the  Ip  summability  of  (||w„||y);,e;r. 

Lemma  4.2  Assume  that  UEAC(r,  R)  holds  for  some  0  <  r  <  R  <  oo.  Let  p  =  )pj)j> i  be  a  S-admissible 
sequence  for  some  0  <  S  <  r  that  satisfies  pj  >  1  for  all  j  such  that  Vj  0.  Then  for  any  v  £  IF  we  have 
the  estimate 

KHv<^  II  4>{Pj){2Vj  +  l)Pp,  (4.9) 

where  <j>)t)  :=  2(t-i)  /or  t  >  1- 
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Proof:  Let  v  =  (vj)j>  1  G  T  be  fixed.  The  coefficient  uv  G  V  is  given  by 


u 


V 


n^  +  D  /  u(y)p^y)d^y)- 

3= 1 


In  the  case  1/  =  0,  the  estimate  (4.9)  is  immediate  since  p{U)  =  1  implies 


(4.10) 


ll^olk  =  ||  /  u(y)dfi(y) \\v  <  sup  ||u(y)||u  <  - —  <  V 


yeu 


S  ' 


We  now  assume  that  v  0.  For  notational  simplicity  we  assume  that  v:j  0  for  j  <  J  and  v:l  =  0  for 
j  >  J  for  some  integer  J  >  1.  This  can  always  be  achieved  by  reordering  the  basis  {ipj)j> i-  Partitioning  the 
variable  y  into 

y  =  y'  ■=  {yj+i,yj+ 2, -  - -)  g  [-i,i]n  =  u, 


we  may  rewrite  (4.10)  as 


where 


=  H(2i/i  +  1)  J  wv{y')dn(y'), 

J=1  rr 


(4.11) 


^(2/0  “ 


/  u(yi,.. 

■  ,yj,y)  ( ] 

J 

1,1]  ^ 

v=1  J 

dyi  dyj 

2  2 


For  a  fixed  y'  £  U,  we  now  use  the  holomorphy  properties  of  (.?!, . . . ,  zj)  e- >  u(zi, . . .  ,zj,yr)  in  order  to 
evaluate  ||w;i,(?/)||y-  For  this  purpose,  we  introduce  for  any  n£  N  the  following  function  of  a  single  complex 
variable  w: 


Qn{w)  :=  f - ds, 

J  w~s 

-l 


|w|  >1,  n—  1,2,.... 


and  the  multivariate  functions 


Qv(zi,  ■  ■  ■ ,  Zj )  : —  1 1  Qvj  (zj) ; 

3  =  i 


(4.12) 


(4.13) 


which  are  well  defined  as  long  as  \zj\  >  1,  whenever  Vj  ^  0.  Following  [10]  (page  19),  we  introduce  for  any 
s  >  1  the  ellipse  in  the  complex  plane 


e.  :={ 


w  +  w 


-l 


=  «}» 


which  has  semi-axes  of  length  s+'^ —  and  's  * — •  For  our  given  p  and  v,  let 


&pj 


be  the  tensor  product  of  these  ellipses  in  the  variables  Zi, ...  ,zj. 

Note  that  the  ellipse  £s  and  its  interior  are  contained  in  the  closed  disc  of  radius  s,  and  therefore  the 
polyellipse  £p,j  and  its  interior  are  contained  in  the  interior  of  the  polydisc  ldPtj  defined  in  (2.16).  Moreover 
2  =  (zi, ... ,  zj,  y')  is  contained  in  Up  for  any  (zi, . . . ,  zj)  in  £Pjj  or  its  interior  and  any  y'  £  U.  Since  [—1,  l]'7 
is  contained  in  the  interior  of  £Ptj,  we  may  thus  invoke  the  same  holomorphy  argument  as  in  the  proof  of 
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Lemma  2.4  and  recursively  apply  Cauchy’s  integral  formula  in  each  ellipse  £Pj  in  the  variables  Zj,  j  =  1, J 
to  obtain  for  any  (ylr. ,  yj)  G  [—1, 1] J  and  any  y'  G  U, 

"<B" ■  ■  >  =  (W ./  (»-„). <414) 

£p 

Multiplying  by  nj=i  and  integrating  over  [—1, 1]J  with  respect  to  p  . . .  p-,  we  therefore  obtain 


wv{y')  =  2  J  J  u(z1,...,zj,y')Q„(z1,...,zj)dz1...dzJ. 


Since  £Pij  is  contained  in  UPtj,  we  find  that  for  all 


Oi,...,zj)  G  £PiJ  and  y’  &  U  =>  (zx, . . . ,  zj,y')  &  UP=>  \\u{zx, . . .  ,zj,y')\\v  < 


I  v* 


Injecting  this  bound  in  the  above  integral  we  thus  obtain 

J 


\\w„(y')\\v  < 


P(nft 

j= 1 


n  o ) ,  ma? , 

z  /  (zi,...,zj)eSP,j 


where  we  have  used  the  fact  that  each  of  the  ellipses  £Pj  has  perimeter  of  length  <  2npj.  We  now  use  the 
following  estimate  established  at  the  bottom  of  page  313  in  [10] 


which  yields 


and  therefore 


7T  t  n 

max\Qn(z)\  <  , 

T  1 


J  7 r  p~Vi 

max  \Qv(zx,...,Zj)\  <  TT - J—, 

(zi,...,zj)e£Ptj  Pj  —  1 


\wv{y')\\v  <  '  §l '  <t>(pi)pj Vj ■ 

5—1 


Combining  this  estimate  with  (4.11),  we  obtain  the  lemma. 


□ 


4.3  A  choice  of  ^-admissible  sequences 

We  again  work  with  the  particular  choice  S  =  |  and  the  estimate  (4.9)  thus  becomes 

IKIIv  <  MdA  Yl  <t>(Pj)(2vj  +  l)pp,  (4.15) 

for  all  ^-admissible  sequence  such  that  pj  >  1  for  all  j  such  that  Vj  p  0  This  estimate  is  slightly  more 
pessimistic  than  the  estimate  (3.1)  for  the  monomial  series  coefficients  due  to  the  presence  of  the  factor 
4>(pj)(2i/j  +  1),  but  we  shall  see  that  this  does  not  affect  the  final  result  on  £p  summability.  For  this  purpose 
we  slightly  modify  the  choice  of  the  sequence  p  introduced  in  §3.1. 

Namely,  we  now  first  fix  1  <  k  <  2  such  that 

(«-  !)  (416) 

5>1 
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(4.17) 


With  this  k  fixed,  we  now  take  Jo  as  the  smallest  integer  such  that 

El(  ,  ,,  —  1) 

m\L°°(D)  <  , 


j>Jo 


and  define  E  and  F  for  this  new  choice  of  Jq.  For  j  £  E  we  again  take  p3  =  k  but  we  now  define 


P j  := 


+  2,  Vj  €  F  such  that  Vj  ^  0, 


(4.18) 


and  pj  =  1  if  j  £  F  and  v3  =  0.  Let  us  show  that  such  a  p  is  |  admissible.  To  this  end,  we  estimate  for 
every  x  £  D 


J2pj\^(x)\  <  K  y  fewi+Ek 

j>  1  j£F 


rv~ 


in ,  H  —  WAx)\  +  2  E  IVvO)l 
j&F  -MUjWl^d)  Ylo 


<  («-!)  E  \^j(x)\+  Y  +  i+2Y  \^(x)\ 

l<j<Jo  l<j<Jo  ]>Jo 

y  +  Y  I^J'(a;)l  +  Y  l^(!E)l 

j>  1  j>Jo 

<  ^  +  Y^(x)i 

3>  1 


< 


where  for  the  last  inequality  we  have  used 


Y  i^(*)i  <  E  ill'll l~(D)  <  <  x. 
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j>Jo  j>Jo 

Using  (2.9)  which  follows  from  UEAC(r,  R),  we  thus  obtain  for  every  x  £  D 

r 
2’ 


Ypi  l^(x)l  ^  K(a(a;))  “ 

j>  i 


and  therefore  p  is  |  admissible.  Since  we  also  have  that  pj  >  1  for  all  j  such  that  Vj  ^  0,  the  bound  (4.15) 
is  thus  valid.  With  our  particular  choice  of  p,  the  estimate  (4.15)  reads 

2||/||v 


\\Uu\\v  < 


(  n  ^(ft)(2zyi+i)r?i/j)(  n  ^(pi)(2^ + !)( 


+  2)-^),  (4.19) 


i£E,Vj^o  jeF,vj3to 

where  77  :=  1  <  1.  Our  next  observation  is  that  for  all  j  such  that  v3  ^  0  we  have  p3  >  k  and  therefore 


4>{pj)  <CK:= 


7 TK 


2(k  —  1)  ’ 

Using  the  crude  estimate  CK(2n  +  1)  <  (3 CK)n  for  n  >  1,  we  find  that  (4.19)  implies  the  estimate 


\\Uu\\v  < 


211/11 


where 


(  n  c«(2,j+w.)(n(bdi 

jeE,ujjio  jeF  3 


(4.20) 


Using  (4.17),  we  observe  that 

iiiii  y^  ;  ^  l2^  11  /  11  ^  12Ck  r(n  —  1)  1 

IMIIf  =  E  ^  - —  E  <  — - — <  3- 


j>Jo 


j>Jo 
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4.4  Proof  of  Theorem  4.1 


Based  on  the  estimate  (4.20),  the  proof  of  the  lp  summability  of  (||uv||y)1/ejr  is  now  very  similar  to  the  proof 
of  the  £p  summability  of  (||ti/||u)i/Gjp  in  Theorem  1.3:  we  estimate 

£  IKIIv  <  cpAEAF, 

as  in  (3.8),  where  AE  and  AE  are  slightly  modified  versions  of  the  factors  AE  and  Ap.  The  first  factor  is 
given  by 

Ae=  £  n  [C&Vi  +  lWrr*  =SJ°, 

vSLTe  j€E,  Vj 7^0 

where 

5:=1  +  C3?£(2n  +  1)VP  <  oo. 

n>  1 

This  gives  AE  <  +oo. 

The  factor  Ap  is  exactly  of  the  same  form  as  Ap  with  the  sequence  ( dj)j>J0  replaced  by  (dj)j>i  which 
has  similar  properties.  Thus  the  same  argument  we  used  to  estimate  Ap  shows  that  Ap  is  finite.  We  have 
thus  proved  the  tp  summability  of  (|| uv \\v)v^p  and  in  turn  of  (||u^||y)I/e^r. 

We  already  know  that  the  series  YA converges  in  L2(U,V,dy)  towards  u,  and  since 

El  IKA||l  °°{U,V)  <  E  \\uv\\v  <  oo, 

this  implies  the  unconditional  convergence  of  this  series  in  L°°(U,  V)  in  the  sense  expressed  in  the  statement 
of  the  Theorem.  The  same  of  course  holds  for  the  series  Yv^f  vvLv  since  it  has  the  same  partial  sums. 

The  convergence  rate  estimate  (4.6)  is  obtained  by  writing  for  any  y  £  U 

IKy)-  £  uvpv(y)\W  <  £  IKIk<  £  in, 

z'G  An  n  n>N 

where  (7n)n>i  denotes  the  decreasing  rearrangement  of  the  Hit^Hy,  and  then  applying  (3.13)  with  q  =  1. 
The  convergence  rate  estimate  (4.7)  is  obtained  by  writing 

llM—  £  L2([/,V,d/x)  —  £  II  W||y  <  £y  7 ni 

t'GAiv  jv  n>N 

where  now  (7„)n>i  denotes  the  decreasing  rearrangement  of  the  ||u„||y,  and  then  applying  (3.13)  with  q  =  2. 

5  Spatial  regularity  and  Finite  Element  discretization 

The  results  of  the  previous  sections  allow  us  to  understand  how  the  functions  u(y)  may  be  jointly  approxi¬ 
mated  for  all  y  £  U  with  a  prescribed  accuracy  by  a  finite  linear  combination  YV£An  ,  YV£An  uvPv{v) 
or  Ei/eAN  W-bjy(y).  The  numerical  realization  of  such  a  linear  combination  would  itself  involve  the  approxi¬ 
mation  of  the  tv,uu,vu  £  V  through  discretization  in  D,  such  as,  for  example,  by  the  Finite  Element  method. 
Specifically,  we  consider  approximation  of  u{y )  in,  for  example,  a  bounded  Lipschitz  polyhedron  D  by  a  one 
parameter,  affine  family  of  continuous,  piecewise  linear  Finite  Element  spaces  {Vh)h>o  on  a  shape  regular 
family  of  simplicial  triangulations  of  meshwidth  h  >  0  in  the  sense  of  [8]  (higher  order,  isoparametric  Finite 
Element  families  in  curved  domains  could  equally  be  considered;  we  confine  our  analysis  to  affine,  piecewise 
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linear  Finite  Element  families  for  ease  of  exposition  only).  Convergence  rates  of  such  Finite  Element  ap¬ 
proximations  are  determined  by  the  regularity  of  u  in  D.  For  this,  further  regularity  assumptions  on  /  are 
required.  Again  for  ease  of  exposition,  we  shall  assume  /  £  L2(D)  C  V*.  Then 


||/||v*  <  CP\\f\\Li(D), 


(5.1) 


where  Cp  is  the  Poincare  constant  of  D  (i.e.  Cp  =  l/yjA\  with  Ai  being  the  smallest  eigenvalue  of  the 
Dirichlet  Laplacian  in  D).  Then  the  smoothness  space  IF  C  F  is  the  space  of  all  solutions  to  the  Dirichlet 
problem 

-A«  =  /  in  D ,  u\qd  =  0,  (5.2) 


with  /  £  L2(D) 


W  =  {v  £  V  :  Av  £  L2(D)}. 


(5.3) 


We  define  the  IF- (semi)  norm  and  the  IF-norm  by 


\v\w  =  ||Au||L2(B),  IMIw  :=  IMIv  +  \v\w-  (5-4) 

It  is  well-known  IF  =  H2(D)  n  V  for  convex  D  C  Rd.  Then  any  w  £  IF  may  be  approximated  in  V 
with  convergence  rate  0(h )  by  continuous,  piecewise  linear  Finite  Element  approximations  on  regular  quasi¬ 
uniform  simplicial  partitions  of  D  of  meshwidth  h  (cf.  e.g.  [8,  6]).  Therefore,  denoting  by  M  =  dim(F/j)  ~ 
h~d  the  dimension  of  the  Finite  Element  space,  we  have  for  all  w  £  W  the  convergence  rate 

inf  \\w  —  Vh\\v  <  CAI~d\w\w-  (5-5) 

Vh&Vh 

More  generally,  for  non-convex  polyhedra,  the  space  W  is  not  contained  in  H2(D),  and  the  convergence  rate 
as  M  =  dim(F/j)  — >  oo  is  reduced  to 


inf  \\w  -  vh\\v  <  CtM  t\w\w-  (5.6) 

Vh&Vh 

with  some  0  <  t  <  jr  Nevertheless,  in  the  case  where  D  C  K2  is  a  non-convex  polygonal  domain,  the  optimal 
approximation  rate  (5.5)  may  be  retained  by  suitable  isotropic  mesh  refinement  towards  the  reentrant  corners 
of  d D  (see  [2]).  Similar  results  are  available  for  non-convex  Lipschitz  polyhedra  in  R3  with  plane  faces  for 
suitable  anisotropic  mesh  refinement  towards  the  reentrant  corners  and  edges  of  dD  (see  [1]). 

We  shall  prove  the  following  result  concerning  W  norms  of  the  tv,  u„  and  v v  and  their  summability 
properties. 

Theorem  5.1  Assume  that  f  £  L2{D)  and  that  a(x,z)  satisfies  UEAC(r,  R)  for  some  0  <  r  <  R  <  oo. 
If  both  (\\4>j\\L°°(D))j>i  €  fp(N)  and  (|| IU~(D))j>i  €  F(N)  for  some  0  <  p  <  l,  then  (\\t„ \\w)vzf, 
{\\uv\\w)v^f  and  {\\vv\\w)ver  belong  to  IP{T). 

Note  that  the  result  for  the  sequence  (||w||rv)^e^r  is  implied  by  that  for  (||u1/||w)i'eJ,:'  clue  to  (4.8).  We 
shall  use  Theorem  5.1  for  the  analysis  of  convergence  of  Finite  Element  discretizations.  In  order  to  prove 
this  theorem,  we  first  study  the  analyticity  properties  of  z  i— >  u(z)  as  a  map  with  values  in  IF  (we  refer  to 
this  as  IF-analyticity).  Accordingly,  this  leads  us  to  estimates  on  the  ||  •  \\w  norms  of  the  coefficients  tv  and 
uu  and  to  their  tv  summability.  Throughout  this  section,  we  append  assumptions  i)  -  iii)  with  the  additional 
assumption:  iv)  the  gradients  of  the  functions  a  and  ijjj,  for  j  >  1,  are  defined  for  every  x  £  D  and  belong 
to  L°°(D). 
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5.1  VT-analyticity  of  u 

We  start  our  proof  of  W-analyticity  with  the  observation  that  if  f  £  L2(D)  and  a  satisfies  the  ellipticity 
assumption  (1.5)  and  is  such  Va  £  L°°(D),  then  the  solution  u  to  (1.1)  belongs  to  W.  Indeed,  from  the 
identity 

-A  u= -(f+Va-Vu),  (5.7) 

a 

we  obtain  the  estimate 

M w  =  I|Au||l2(D)  <  -(||/||z,2(£))  +  ||Va||Loc(£))||M||v)  <  -(||/||l2(u)  +  ||Va||i,°o(j3)  ),  (5.8) 

and  therefore, 

\\u\\w  <  -  (i  +  Cp(l  +  - - ^  (£>)))||/IU2(J>)-  (5.9) 

For  0  <  8  <  2 R  and  B  >  0,  we  introduce  the  complex  domain 

As, b  '■=  {z  £  CN  ;  8  <  $i(a(x,z))  <  \a(x,z)\  <  2 R  and  |Va(x,  z)|  <  B  for  all  x  £  D},  (5.10) 

where  the  gradient  of  a  is  taken  with  respect  to  the  x  variable.  It  is  readily  checked  that  under  the  assumptions 
of  Theorem  5.1,  for  0  <  S  <  r  and  sufficiently  large  B  the  set  As,b  is  non-empty.  From  (5.9),  it  is  clear  that 
u(z)  £  W  for  all  2  £  As,b  and 

sup  ||u(2)||w  <  Cs,b  ■=  ^  (l  +  Cp(l  +  ||/||l2(d)-  (5-11) 


We  will  prove  W-analyticity  of  u  on  As.b  by  using  once  more  a  difference  quotient  argument.  The  bounds 
on  the  difference  quotient  require  the  following  perturbation  result. 


Lemma  5.2  Let  u  and  u  be  solutions  of  (1.2)  for  the  same  f  £  L2(D)  with  coefficients  a  and  a  which  satisfy 
(1.5),  and  which,  in  addition,  are  such  that  Va  and  VS  belong  to  L°°(D).  Then  there  holds  the  estimate 


\u  —  u\w  <  -^||a  —  S||i,oo(£>)|«|w  +  ||V(a  —  a)||i,oo(£))|M|y  +  \\^ ®\\ l°° (D)\\u  —  w||y) • 

Proof:  We  know  from  (5.9)  that  u,u  £  W.  Moreover,  they  satisfy  SA u  —  oA'u  =  Va  •  V« 
Therefore  we  get 

A(w  —  u)  =  —  ^(a  —  a) Au  +  V(a  —  a)  •  Vu  +  Va  •  V(zt  —  u)^j . 

Since  a  satisfies  (1.5),  we  obtain  (5.12)  by  taking  the  L 2  norm  of  this  identity. 


(5.12) 


VS  •  Vu. 


□ 


Lemma  5.3  At  any  z  £  A$,b>  the  mapping  z  i— >  u(z)  admits  a  complex  derivative  dz.u(z )  £  W  with  respect 
to  each  variable  Zj. 

Proof:  From  the  proof  of  Lemma  2.2,  we  know  that  the  difference  quotient  Wh{z)  is  solution  to 
—  div  (a(-,  z)Vwh )  =  Lh  =  V'i pj  ■  Vu(z  +  hej)  +  ipjAu(z  +  hej)  £  L2(D), 


and  therefore 


-Awh  = 


a(-,z) 


^Va(-,  z)  ■  Vwh  +  V0j  •  \7u(z  +  hej)  +  ipjAu(z  +  hej)J . 
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We  already  know  from  Lemma  2.2  that  Wh  converges  in  V  towards  wq  =  dZju(z).  Similarly  wq  is  solution  to 


-Awn  = 


■  ^Va(-,  z)  •  Vu>o  +  V? j}j  ■  X7u(z)  +  ipjAu(z)j . 


a{-,z) 

Both  Wh  and  wq  are  therefore  in  W,  and  by  subtracting  the  two  equations  we  find  that 
I  Wh  -  W0\w  <  ^  (B\\wh  -  wholly  +  \\Vi)j\\Loo(D)\\u(z  +  hej)  -  u(z)  \\v  +  ||VblU~(r>)lu(2  +  hef)  -  u(z) |w)- 


As  h  —>  0,  the  three  terms  on  the  right  hand  side  tend  to  0,  by  Lemma  2.2,  2.1  and  5.2,  respectively.  This 
completes  the  proof.  □ 


5.2  Proof  of  Theorem  5.1 

Analogous  to  §2.1,  we  say  that  a  sequence  p  is  (5,  B)-admissible  if  and  only  if  for  all  x  G  D, 

EftlVbWI  <  Sft(a(qQ)  -  S  and  ^  Pj |V^j(aQ|  <B  -  ||Va||i,°c(D).  (5.13) 

j> i  j> i 

It  is  immediate  to  check  that  if  p  is  (5, 13)-admissible,  then  the  polydisc  Up  is  contained  in  Ays.  This  allows 
us  to  establish  the  following  result  for  estimating  the  Taylor  and  Legendre  coefficients. 

Lemma  5.4  //  UEAC(r,  J?)  holds  for  some  0  <  r  <  R  <  oo  and  if  p  =  (pj)j> i  is  a  (5,  B) -admissible 
sequence  for  some  0  <  S  <  r  and  a  sufficiently  large  value  of  B  >  0,  then  for  any  v  €  T  we  have  the  estimate 

IIMIw  <  Cs!bP~1',  (5-14) 

where  Cs,b  is  as  in  (5.11)  and  where  we  use  the  convention  that  t~°  =  1  for  any  t  >  0.  If  in  addition,  the 
sequence  p  satisfies  pj  >  1  for  all  j  such  that  Vj  ^  0,  we  have  the  estimate 

\WA\w  <Cs,B  TT  <j>(pj)(2vj +  1  )p~v\  (5.15) 

where  <p{t)  :=  2(t-i)  for  ^  > 

Proof:  the  proof  of  (5.14)  is  the  same  as  that  of  Lemma  2.4  and  the  proof  of  (5.15)  is  the  same  as  that  of 
Lemma  4.2,  using  analyticity  and  the  global  bound  (5.11).  □ 

We  may  now  complete  the  proof  of  Theorem  5.1.  Once  again  we  work  with  the  particular  choice  S  =  |. 
In  order  to  prove  the  £p  summability  properties  announced  in  Theorem  5.1,  we  need  to  slightly  modify  the 
definition  of  the  ^-admissible  sequences  p  which  were  proposed  in  §3.1  and  §4.3,  since  they  should  now  also 
satisfy  the  second  condition  in  (5.13)  for  some  fixed  B  >  0. 

Let  us  explain  this  modification  in  the  case  of  the  estimates  for  the  ||f„||ry.  We  first  choose  Jq  large 
enough  such  that 

E  (II^IU~(2»  +  HVVblUoop))  <  (5.16) 

j>Jo 

We  again  split  N  into  the  two  sets  E  :=  {0  <  j  <  J0}  and  F  :=N\E,  and  we  choose  k>  1  such  that 

(K-l)  E  II' W5'IUoo(d))<^  (5.17) 

1  <j<Jo 
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For  our  given  v  we  use  the  sequence  p  defined  by 


vis  ■ 

Pn=^{i,4M(|k.|k.(D)1+||^j|U.(D))t  jer-  W ) 

By  the  same  considerations  as  in  §3.1,  we  find  that 

*52  Pj\i>j(x)\  <  M(a(x))  - 

J>  i 

but  we  also  find  that  for  every  x  €  D 

Y.PiWM*)\  +  I|Vq||/,°°(£>)  <  B  :=  k  Y.  l|V^j||L°o(D)  +  Y,  HVV’jllioo^)  +  -  +  ||Va||x,ao(£)).  (5.19) 

j>  i  i<j<Jo  j>Jo 

We  thus  find  that  p  =  (Pj)j>i  is  (| ,  B)-admissible  with  this  choice  for  B.  This  leads  to  the  estimate 

iM^<cf,B(n^)(n(^r)-  (5-20) 

j£E  jeF  3 


where  r\  :=  -  <1  and 

,  _  JIVblU00(.D)  +  l|V^>j||L~(D) 

ai  4  r  ’ 

satisfies  ||d||*i  =  J2j>Jo  di  <  §• 

From  then  on,  the  proof  of  the  fp-summability  of  the  ||t„||iy  is  exactly  the  same  as  in  §3.2,  based  on 
the  estimate  (5.20).  A  similar  modification  of  the  sequence  p  proposed  in  §4.3  in  the  case  of  the  Legendre 
coefficients  leads  to  a  similar  conclusion.  The  proof  of  Theorem  5.1  is  therefore  complete.  □ 


5.3  Convergence  rates  of  finite  element  approximations 

We  finally  discuss  the  approximation  of  u  by  a  linear  combination  of  the  form  |ygA  Cj/X  XXgA  di'Pv(y),  or 
XXeA  VvLviv)  where  A  C  T  is  finite  and  when  the  coefficients  tv,  u v  and  vv  are  Finite  Element  approxima¬ 
tions  of  tv,  uv  and  vv,  respectively,  from  finite  element  spaces  (WXgA  in  the  one-parameter  family  {Vh)h> o 
in  (5.6).  As  indiated  in  [9,  5],  to  achieve  optimal  approximation  rates  in  terms  of  the  overall  number  of 
degrees  of  freedom  denoted  by  Ndof,  it  will  be  crucial  that  for  given  v  £  A  C  T,  the  approximation  space 
Vv  may  depend  on  v. 

Let  us  consider  the  Taylor  expansion  (1.14).  Under  the  assumptions  of  Theorem  5.1, 

Cv  :=  ||(||M|v)||^(^)  and  Cw  :=  \\(\tv\w)\\ip(F),  Cw  ■=  ||(||C||w)||^(;f) 

are  finite.  We  introduce  the  vector  A4  =  {Mv)ve a  of  the  dimensions  M„  =  dimVi,,  v  £  A,  of  the  finite 
element  approximation  spaces  V„  used  for  approximating  the  tv.  Note  that  for  a  sequence  of  Finite  Element 
spaces  obtained  from  successive  mesh  refinements,  not  all  integers  M  may  arise  as  dimensions.  Moreover, 
when  optimizing  the  choice  of  M„  it  will  be  convenient  to  allow  Mu  to  take  noninteger  values  in  (0,  oo).  We 
assume  for  now  that  the  error  bound  (5.6)  holds  for  all  such  M  up  to  increasing  C\  in  this  bound  (we  will 
ultimately  remove  this  assumption  below). 

Thus,  we  express  the  approximation  rate  in  terms  of  the  total  number  of  degrees  of  freedom  involved  in 
this  approximation: 

N^f  ■=  Y  M-  (5-21) 

i/gA 
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The  approximation  error  in  L°°(U ,  V)  may  be  estimated  by 


sup  II u(y)  -  Y  W' Ik  <  Y  Wtv  -  +  E  IMk-  (5.22) 

y^  i/£A  i/SA 

The  hrst  term  in  the  right  hand  side  of  (5.22)  corresponds  to  the  error  occuring  from  the  finite  element 
discretization  of  the  t„.  According  to  (5.6),  we  may  find  G  Vv  such  that 

\\tv-iv\\v<CtM?\tv\w.  (5.23) 


For  example,  we  may  take  for  tu  the  V-orthogonal  projection  of  t „  onto  Vv. 

The  second  term  in  the  right  hand  side  corresponds  to  the  error  incurred  by  truncating  the  Taylor  series. 
By  taking  A  :=  AN  the  set  of  indices  corresponding  to  N  largest  |  tv\\v,  it  is  bounded  by 

Y  IMk  <  CVN~S,  a  :=  -  -  1.  (5.24) 

^  J  p 

Therefore,  the  global  error  is  bounded  by 


sup  ||tt(y)  —  Y  VVWv<Ct  Y  M^\ t„\W  +  CvN-*.  (5.25) 

yeU  ^eAjv  i/eAjv 

We  now  allocate  the  degrees  of  freedom  Mv  in  such  a  way  that  the  total  number  is  minimized  for  a  fixed 
contribution  Ct  X^eA?  ,  *\tv\w  to  the  error.  Since  the  global  error  bound  (5.22)  also  contains  the  term 
CyN~s  which  is  independent  of  this  allocation,  it  is  natural  to  require  that  both  contributions  be  of  the 
same  order.  We  therefore  consider  the  minimization  problem 

min{  Y  M»  S.  M~*\tv\w  <  N~s}.  (5.26) 


To  solve  this  problem,  let  us  first  treat  the  Mv  as  continuous  variables.  Introducing  a  Lagrange  multiplier, 
we  obtain 

Mv  =  p \K\Y\  (5.27) 

for  some  77  >  0  independent  of  v  G  A at-  Its  value  is  determined  by  the  saturated  constraint 

N~s=  Y  M~t\K\w  =  r1-t  Y  (5-28) 

is£  An  vEAn 

and  therefore 

V  =  Ni  (Y  ^wY  ■  (5-29) 

A^v 

Combining  this  with  (5.27)  and  summing  over  v  G  A_/v,  we  find 

i  i+* 

Ndof=Nl(Y  *  •  (5-30) 

An 


We  now  distinguish  between  two  cases. 

(i)  t  <  s:  This  also  means  that  p  <  and  therefore 

E  >''\w  <  Cp  (5.31) 

Ajv 
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for  any  set  A n.  According  to  (5.30),  we  thus  have 


Ndof  < 


(5.32) 


Combining  this  with  the  fact  that  the  global  error  is  controlled  by  ( Ct  +  Cy)N  s,  we  find 


sup  |Mj/)  - 
y&u 


E  l»VV\ lv  <  CN~) 

is(zl  An 


(5.33) 


where  C  :=  (Ct  +  CV)CW. 

1 

(ii)  s  <  t:  in  this  case  X^eAiv  IMvv*  may  not  be  uniformly  bounded  and  we  estimate  it  using  Holder’s 
inequality  that  gives 

E  I U\fr<C$*N*,  S:=  1--^L_>0. 

According  to  (5.30),  we  thus  have 

I  s  +  (l+t)<5  I 

Ndof  <  CyyN  *  =  C^N.  (5.34) 


Combining  this  with  the  fact  that  the  global  error  is  controlled  by  (Ct  +  Cy)N  s,  we  find 

sup  | \u(y)  -  E  tvyv\W  <  CNdof  (5-35) 

yGU  v£An 

where  C  :=  (Ct  +  CV)CW. 

We  may  summarize  as  follows  the  above  dichotomy: 

•  In  the  first  case  the  rate  of  convergence  N^  is  governed  by  the  space  discretization,  since  it  is  the 
same  as  the  rate  that  would  occur  when  approximating  a  single  instance  u(z)  in  the  V  norm. 

•  In  the  second  case,  the  rate  of  convergence  N^0Sf  is  governed  by  the  discretization  in  the  parameter 
variable,  since  it  is  the  same  as  the  rate  that  would  occur  without  any  space  discretization. 

This  analysis  therefore  reveals  that  when  the  index  set  A  and  the  finite  element  spaces  Vv  are  properly  chosen, 
then  the  number  of  degrees  of  freedom  resulting  from  space  discretization  and  parameter  discretization 
essentially  do  not  multiply.  This  finding  corresponds  to  the  error  bounds  obtained  for  sparse  tensor  Finite 
Element  discretizations  in  [5]  under  stronger  assumptions. 

In  the  above  derivation,  however,  we  assumed  Mv  to  be  real-valued.  To  circumvent  this  problem,  we 
assign  for  such  a  real-valued  Mv  the  subspace  Vv  of  dimension  \_M„ J .  Therefore, 

Ndof  =  E  dim Vm„  ^  'y  '  Mv. 

However,  the  approximation  error  estimate  (5.23)  is  no  longer  valid,  but  one  easily  checks  that  it  can  be 
replaced  by 

\\U  -  t„\\v  <  CtM-^UWw  (5.36) 

with  Ct  =  max{l,2 tCt}.  Solving  the  modified  minimization  problem 

min{  E  E  Mu*\K\\w  <  N~s}  (5.37) 

Z/'GAjv  i^GAjv 
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we  end  up  with  the  same  estimates  (5.33)  and  (5.35),  now  with  C  :=  (Ct  +  Cy)Cw- 

A  similar  analysis  applies  to  the  approximated  Legendre  expansions  ’Y2l/p^uvPv(y)  with  the  error  mea¬ 
sured  in  L°°(U ,  V)  and  YlveA  VvLv{y)  with  the  error  measured  in  L2(U,  V. ,  dp).  We  collect  these  findings  by 
the  following  theorem.  We  denote  by  tv,  u u  and  vv  the  ^-projection  of  tv,  uu  and  vv,  respectively,  onto  Vv. 


Theorem  5.5  Assume  that  the  finite  element  spaces  have  the  approximation  property  (5.6).  Then  under 
the  same  assumptions  as  in  Theorem  5.1,  the  following  holds: 

(i)  With  An  the  set  of  indices  corresponding  to  N  largest  ||f„||y,  there  exists  a  choice  of  finite  element 
spaces  Vv  of  dimension  Mv,  v  £  An,  such  that 

sup  ||«(y)  -  v  <CN~0fln{s’t},  s  —  1, 

y*u  Jks  p 

where  Ndof  =  J2v&an  and  C=(Ct  +  ||(||i1/||v)||^(^))||(||i1/||w)||<*>(^)- 

(ii)  With  A n  the  set  of  indices  corresponding  to  N  largest  ||Ui,||y,  there  exists  a  choice  of  finite  element 
spaces  Vv  of  dimension  Mv,  v  £  An,  such  that 

sup  \\u(y)  —  UvPv(y)\\v  <CN~  Jin[s’t},  s:=  -  -  1, 

y^u  Jts  p 

Ndof  =  J2vEAn  and  C  =  (Ct  +  ||(||u1/||y)||£p(^r))||(||ttl/||ly)||^(^). 

(iii)  With  An  the  set  of  indices  corresponding  to  N  largest  IKIIv,  there  exists  a  choice  of  finite  element 
spaces  Vv  of  dimension  Mv,  v  £  An,  such  that 

llu_  W-MU 2(u,v,dn)  <  CNdoJln^s’^ ,  s  := - -, 

uEAn  V  Z 

where  Ndof  =  J2v&an  m»  and  c  =  (C?  +  ll(IMy)||?P(:F))5  ||(IMw)||*p(:f)- 
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